Online Knowledge Distillation with Diverse Peers
نویسندگان
چکیده
منابع مشابه
Topic Distillation with Knowledge Agents
This is the second year that our group participates in TREC’s Web track. Our experiments focused on the Topic distillation task. Our main goal was to experiment with the Knowledge Agent (KA) technology [1], previously developed at our Lab, for this particular task. The knowledge agent approach was designed to enhance Web search results by utilizing domain knowledge. We first describe the generi...
متن کاملSequence-Level Knowledge Distillation
Neural machine translation (NMT) offers a novel alternative formulation of translation that is potentially simpler than statistical approaches. However to reach competitive performance, NMT models need to be exceedingly large. In this paper we consider applying knowledge distillation approaches (Bucila et al., 2006; Hinton et al., 2015) that have proven successful for reducing the size of neura...
متن کاملEducational Intervention on effects' Peers Knowledge and Behaviors of Students with Diabetes Type I
Background and Objectives: Regarding the important role of peers in health behaviors of adolescents suffering from chronic diseases such as diabetes, this study aimed to assess the effects of an educational program on the knowledge and behaviors of the peers of students with Type 1 diabetes in Shahre kord in 2012. Material and Methods: In this experimental study, 64 students were randomly assig...
متن کاملLeveraging the Knowledge of Our Peers: Online Communities Hold the Promise to Enhance Scientific Research
Cancer incidence in the Dalgety Bay area of Fife, Scotland, was examined following the detection of radium-226 particles by routine radiation monitoring. The study was confounded by rapid population growth, demographic change and the relatively high socioeconomic status of the Dalgety Bay population. Health Board Primary Care Division records were used to calculate population estimates and Cars...
متن کاملLearning Loss for Knowledge Distillation with Conditional Adversarial Networks
There is an increasing interest on accelerating neural networks for real-time applications. We study the studentteacher strategy, in which a small and fast student network is trained with the auxiliary information provided by a large and accurate teacher network. We use conditional adversarial networks to learn the loss function to transfer knowledge from teacher to student. The proposed method...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Proceedings of the AAAI Conference on Artificial Intelligence
سال: 2020
ISSN: 2374-3468,2159-5399
DOI: 10.1609/aaai.v34i04.5746